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(54) IMAGE AREA DIVIDING DEVICE 

(57)Abstract: 

PURPOSE: To provide the image dividing device which 
can accurately and automatically extract an area 
concentrating the spatial frequency component of an 
input image and an area not concentrating it while 
shortening processes. 

CONSTITUTION: An image is picked up. transformed to 
a digital signal image SI and transformed to an image S2 
expressing a sense table color system by a table color 
system transformation part 3, This image S2 is divided 
into small areas by a small area division part 4 and 
transformed to an image S4 of the frequency 
component by a frequency component transformation 
part 5. This image S4 is merged to an image S5 in the 
size of the source image by an area merge part 6 and for 
the image of the frequency component for each merged 
small area, the spread of distribution to a frequency is 
extracted by a distribution extraction part 7. '\ 
Corresponding to an image S6 expressing the spread of 
the distribution to the frequency, an area candidate 
separation part 8 separates the areas into the concentrating area candidate concentrating the 
spatial frequency component and the distributed area candidate not concentrating the 
component, the spatial frequency component concentrating area is extracted, an image S9 is 
outputted, the distributed area is extracted and an image S10 is outputted. 
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[0008] 

[Embodiment of the invention] Fig. 1 is an outline of a block diagram of an 
embodiment of the invention. First, the configuration of the invention is explained 
referring to Fig. 1. The image area dividing device contains a video camera 1 as a 
photography means for photographing objects. A video signal photographed by the 
video camera 1 is provided to an A/D converter 2 and transformed to a digital signal 
image SI. The digital image SI transformed by the A/D converter 2 is provided to a 
table color transformation system 3 and transformed to an image S2 expressing a sense 
table color system. The image S2 is provided to a small area division part 4 and 
divided into the image S3 within a small area. The divided image S3 in each small 
area is provided to a frequency component conversion part 5 and transformed into an 
image S4. This image S4 that is transformed to a frequency component for each small 
area is provided to an area merge part 6 and is merged into an image SS in the size of 
the source image. 

[0009] 

The image S5 in the size of the source image merged by the above area merge part 6 is 
provided to a distribution extraction part 7 and the spread of the distribution to a 
frequency of a frequency component for each small area is extracted. An image 86 
expressing the spread of a distribution to the frequency extracted is provided to an area 
candidate separation part 8 and separated into a concentrating area candidate 
concentrating spatial frequency components and a distributed area candidate not 
concentrating spatial frequency components. The separated image S7 is provided to a 
concentration area extraction part 9 and an image S9 to which the extracted 
concentration area of a spatial frequency component is output. An image S8 separated 
in an area candidate separation part 8 is provided to a distribution area extraction part 10 
and an image SIO in which a distribution area of a spatial frequency component is 
extracted is output. 

[0010] 

Fig. 2 is a diagram showing the output images SI and S2 in an embodiment of Fig. 1 
when a human face is used as an object and Fig. 3 is a diagram for explaining the small 
area division part 4, a frequency component conversion part 5 and the area merge part 6 
in which the output images S3, S4 and S5 in Fig. 1 are shown in an embodiment in 



which an image is separated into small areas of 16x16 pixels when a human face is used 
as an object. Figs. 4 and 5 explain the extraction of the spread of distribution to a 
frequency of a frequency component image in which an embodiment is shown when an 
image is separated into small areas of 16x16 pixels. Fig, 6 is a diagram showing the 
images S6, !S7 and S8 in an embodiment of Fig. 1 when an image is separated into small 
areas of 4x4 pixels when a human face is used as an object and Fig. 7 is a diagram 
showing the images S9 and SIO in the embodiment of Fig. 1 when an image is separated 
into small areas of 4x4 pixels when a human face is used as an object. 

[0011] 

Next, specific operations of an embodiment of the invention are explained. An image 
of a human face as an object is photographed by the video camera 1. The image signal 
photographed by the video camera 1 is transformed into an RGB digital signal SI of 
512x512 pixels by the A/D converter 2. The RGB digital signal SI sets an axis as an 
image in which the object is projected in a plane surface of x - y as shown in Fig. 2 (a), 
which indicates an image of a G component and an axis. The RGB digital signal SI is 
provided to the table color transformation system 3 and transformed into the image 
signal 82 expressing colors of the sense color table system, which uses a transformation 
formula of the color table CIE1976L*a'**b* indicated in Fig. 2(b). 

[0012] 

In an embodiment when a human face is used as an object, performing a transformation 
using a color table system and a color image unlikely to be influenced by shades is 
effective. This embodiment of the invention contains a table color transformation 
system part 3, The image S2 transformed by the table color transformation system 3 is 
provided to the small area division part 4 and an image is divided into the image S3 of 
small areas shown in Fig. 3 (a). Fig. 3 shows how the image S3 is divided into 32 x 32 
blocks in small areas of 16 x 16 pixels in which the x-axis and y-axis indicate a 
coordinate axis of the image and the z-axis indicates color phase values. The image S3 
in each small area divided by the small area division part 4 is provided to the firequency 
component conversion part 5 and, using an optical Fourier transformation indicated in 
Fig.3 (b), it is transformed into the image 84, which expresses a frequency component 
in small areas whose value is a square of a power spectrum 

[0013] 

Fig. 3 shows an image transformed into a frequency component in a small area of 16x16 



pixels separated by the small area division part 4 in which Fx and Fy represent the 
frequency axis in the direction of the x-axis and y-axis, and the z-axis represents the 
strength of a frequency component. The image S4 in the frequency component 
converter 5 that is transformed into a frequency component for each small area is 
provided to the area merge part 6 and merged as the image S5 in the size of the source 
image. The image S5 having a frequency component in each small area merged by the 
area merge part 6 is provided to the distribution extraction part 7 and the spread of 
distribution to a frequency is extracted by performing a threshold processing and a 
two-value processing. 

[0014] 

Here, the extraction of the spread of distribution of a frequency component in a small 
area is explained by referring to Figs. 4(a) and (b) and Figs. 5 (a)and (b). In Figs. 4 
and 5, Fx and Fy represent the frequency axis in the direction of the x-axis and y-axis in 
a small area. Fig, 4 (a) and Fig. 5 (a) indicate an image of 16x16 pixels whose 
frequency component in a small area is transformed in the small area division part 4 and 
the X-axis represents the strength of a frequency component. In general, the greater 
portion of image signals are known to be concentrated on the side of low-frequency. 
Since Fig, 4(a) and Fig. 5(a) show an embodiment when a human face is used as an 
object, frequencies are concentrated on the low-frequency side as a whole, that is, in the 
part near the center of Fig. 4(a) and Fig. 5(a). Fig. 4(b) and Fig. 5(b) show an 
embodiment after a threshold processing and a two-value processing are performed on 
each image shown in Fig. 4(a) and Fig. 5(a), and express a detected result as the z-axis 
representing the presence/absence of a frequency component, 0 indicating the absence 
of a frequency component and numbers other than 0 indicating the presence of a 
frequency component. 

[0015] 

Fig. 4(a) shows as an example an embodiment of a distribution of an image in a divided 
small area, when low-frequency components as specific frequency components are 
concentrated. Fig. 4(b) shows an embodiment that is a result of performing a threshold 
processing and a two-value processing on the images having the distribution shown 
in Fig. 4(a), and the image concentrated on a certain part of a small area is outputted. 
Fig. 5(a) shows an embodiment of a distribution of an image in a divided small area 
when specific components are not concentrated. Fig. 5(b) shows an embodiment that is 
a result of performing a threshold processing and a two-value processing on the images 



having the distribution shown in Fig, 5(a), and an image spread inside of a small area is 
output. As shown in Fig. 4(b) and Fig. 5(b), the spread of distribution of a frequency 
component is detected by performing a threshold processing and a two-value 
processing. 

[0016] 

In the distribution extraction part 7, the spread of the frequency components in a small 
area is detected for the whole image by performing a threshold processing and a 
two-value processing, explained in Fig. 4 and Fig. 5, to the image S5 having 
frequency components in each small area merged in the area merge part 6. In Fig. 6(aX 
which shows the output image S6 in the embodiment of Fig. 1 in which an image is 
divided into small areas of 4x4 pixels, when a human face is used as an object, not only 
low-fi-equency components as in the hair area but also areas contmning high*frequency 
components attain such a state that small areas indicating the spread of the distribution 
of frequency components of the distribution extract part 7 are concentrated and areas 
where low- frequency components are concentrated, as in the face area, indicate a state 
in which frequency components are concentrated within small areas. 

[0017] 

The image S6 indicating the spread of distribution of a frequency extracted in the 
distribution extract 7 is provided to the area candidate separation part 8, spatial image 
processing are provided to the two value images for pixels less than 3x3, such as by the 
removal of independent pixels less than 2x2, and a bridge connection and a majority 
vote processing are also provided. For example, as an embodiment when a human face 
is used as an object, it can easily be divided into the concentration area candidate image 
S7 where the spatial frequency components shown in Fig. 6 (b) are concentrated and the 
distribution area candidate image S8 where spatial frequency components indicated in 
Fig. 6(b) are not concentrated. 

[0018] 

The image S7 and S8 separated in the area candidate separation part 8 are provided to 
the concentration area extraction part 9 and the distribution area extract part 10, 
respectively. By providing spatial image processing to the two-value images for pixels 
less than 3x3, such as by the removal of independent pixels less than 2x2, providing a 
bridge connection and a majority vote processing, and providing image processing 
relating to area extraction such as outline extraction and the filling of closed areas, the 



area where spatial frequency components are concentrated and the area where spatial 
frequency components are distributed are extracted. For example, the image S9 
indicating the output of a spatial frequency components concentration area shown in Fig 
7 (a) and the image SIO indicating the output of a spatial frequency components 
distribution area shown in Fig 7 (b) are output, 

[0019] 

It should be noted that the table color transformation system 3 that performs 
transformation into the sense color system shown in Fig. 1 performs a processing 
unlikely to be influenced by shades from a light source, for example, a human face as an 
object. As a conversion equation, the transformation formula of a sense color system 
"CIE19761*a*b*"and other transformation formulas, for example, "CIE1976L*u*v*", 
the transformation formula of a sense color system described in "'New Color Science 
Book" (Tokyo University Publication, 1985) can be used. However, depending on the 
objects used to peiform area division, the table color transformation system 3 is not 
required and the RGB digital signal SI output from the A/D converter 2 shown in Fig. 1 
can be used directly. In addition, as a conversion equation for transforming it into the 
frequency component in the frequency component conversion part 5 shown in Fig. 1, 
Fourier transformation and other transformation formulas, for example, the 
Walsh-Hadamard conversion described in "Television Image Information Engineering 
Handbook" (Ohmsha, 1990) compiled by the Television Academy can be used . 

[0020] 

As described above, according to this embodiment, an image can be transformed into 
image having partial frequency components relating to small areas of an image using 
the small area separation part 4, the frequency components conversion part 5 and the 
area merge part 6 shown in Fig. 1. Since the transformation is performed on smaller 
areas of an image than the conventional transformation performed for the whole image 
to extract frequency components, the weakness point of lower extraction accuracy can 
be improved. In addition, another characteristic is that a reverse transformation after 
analyzing frequency to use the transformed image of the frequency components as it is 
need not be performed. Moreover, compared to the statistical analysis method in 
which a co-occurrence probability in a pixel unit is calculated using the image value 
surrounding the object pixel and the characteristic area relating to the spatial frequency 
of the image is extracted, the calculation amount will be reduced and the processing 
speed will be faster because the transformation is performed in a small area unit. 



Specifically, in the embodiment of the invention, area extraction is performed using the 
outputted image transformed to a sense color system that is unlikely to be influenced by 
shading of a light source in the table color transformation system 3 shown in Fig, 1, and 
the stabilized extraction can be performed. 
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